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(57) Abstract 

Multiple users interact through a medical electronic records database system. A first user sends to a second user an electronic 
notification having a pointer to a record. The notification is being delivered through push technology. The second user uses the pointer to 
retrieve the record through pull technology. The notification is being indexed in the database system as related to the record. The users can 
personalize the modality of the push and pull technologies. 
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Indexing and web-technologies control interacting with database. 



FIELD OF THE INVENTION 

The invention relates to a method for accessing, through a client-server 
architecture, multimedia data distributed across heterogeneous databases. The invention relates 
in particular to such a method within an electronic medical record (EMR) environment. 

5 

BACKGROUND ART 

The ongoing development in the medical fields of diagnostics and therapy has 
led to an ever increasing number of techniques, and to dramatic changes in the delivery of 
health care and in the payment for health care services. Medical documents have become 

10 inherently multimedia, ranging from structured written reports and free text to non- 
alphanumeric data such as medical images, video streams, physiologic monitoring signals, 
voice dictation and graphics. The result of all this is that the complexity of managed care and 
of patient information has expanded greatly. Paper- and film-based recording systems and 
isolated, individual departmental information managing systems seem to have reached the 

1 5 point that they are no longer adequate in meeting the needs of integrated care. 

OBJECT OF THE INVENTION 

Hospitals and care provider organizations need a new information model to 
communicate, distribute, and manage correlated patient information items in an efficient and 
20 ebst T effective manner, while maintaining or even improving the quality of care. Therefore, it is 

an object of the invention to provide a method of managing interaction with electronic record 

■■ ' '< . ■ • ■ •■ • . , .> 

databases. . ...... 

■ SUMMARY OF THE INVENTION 
25 . .. Tothis end,.the invention provides a method o£ interacting between multiple.***, ™ 

users through an electronic records, database system. A first user sends to a second user an 
electronic notification haying a poihter to a record. The notification is being delivered through 
a push technology. The second user, uses the pointer to retrieve the record through a pull ; 
technology. The notification is being indexed in the database as related to the record. If the 
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first user sends an electronic message in response to the notification, to e.g., a third user, the 
message is indexed in the database as reliated to the record. Preferably, the notification is 
customized according to a specification by the second user with regard to a modality of 
reception by the second user, the specification having been stored in the database. The 
5 modality may relate to; e.g., electronic receiving equipment of the second user, or to a 7 
temporal relevance of the notification. 

' : ; The invention is based on the following insights. The World Wide Web (or the 

Web) is the vast collection of electronic information resources accessible on the Internet 
through a client-server architecture. A client-server computer architecture is an information 
10 processing system with a server computer that enables processing power, data files and i 
program files to be shared among multiple client computers interconnected to the server 
through a network. The Web is interacted with typically using a pull 1 technology. The term 
"pull* technology" "refers? to the mode of interaction according to ; which the user clicks the links 
on the Web to request the server to send information. That is; the user has to f request for each 
' 1 5 piece of information that he/she needs to access/typically after' querying the Web. Browsing 
: the Web and using bookmarks are examples of the pull model. On the other hand, "push- 
technology" is data distribution according to which selected data is delivered automatically to 
the user's computet: This type of delivery is also referred to as "webcasting". Delivery of data 
can be at prescribed intervals or can be based on some prescribed events. An example of push- 
20* technology is PointCast, which is an Internet service for periodically pushing selected news 
1 and stock quotes into 1 a subscriber's machine; Marimba's Castanet provides a push delivery for 
updating applications as well ks distributing publishing content. ' 

The invention now combines push-technology and pull-technology and 
automatic indexing services in a single architecture. The architecture creates an efficient 
25 procedure to manage and access the large numbers of records distributed among multiple 
locations and available in a variety of formats ori a web-based networked system. The 
messaging between users is automatically indexed to keep the database up to date. For relevant 
Web-related technologies, especially as applied to the medical environment, see for example, 
' U.S. patent applications Ser. No's 08/785,459 (PHA 23,217 [personalizing intranet websites]); 
30 0&/87 1,035: ' , ■ v " : • - - ■>•. 

(PHA : 23,255 [biometrics]); and 08/924,867 (PHA 23,273 [authentication 
^security])', incorporated herein by reference. 1 " ' : 
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; . . BRIEF DESCRIPTION OF THE DRAWINGS . . . . ; r - 

■ '■ • The invention is explained by way of example and with reference to the 

accompanying drawings, wherein: 

Fig.l is a block diagram of a system architecture in the invention; 
5 , Fig.2 is a workflow diagram .illustrating the messaging procedure in the system. 

\, Throughout the figures, same reference numerals indicate similar or 

; , corresponding features. 

10 PREFERRED EMBODIMENTS - .. . . 

i . An example of a field of application in the invention relates, to. medical records. 

• . i. The current trend in managing electronic medical records is towards distribution across 
' networked information systems, especially as driven by the Integrated Delivery Network 
(IDN)-in the healthcare industry. Tracking of the records becomes one of the Ingest overheads 
15 • in the medical environment. Due to the huge amount of data including audiq^ video, graphics 
/ . • , images and text reports, some or all involving mission critical criteria, current pushing 

: technology is not appropriate. According to. the invention, by using the Web-based 
.: 1 . technologies the medical specialist can subscribe to receipt of the required data. The indexing 

..i to those data is organized and pushed t tp, those subscribers whenever it is available. The 
20 . subscribers can set the criteria on the relevance of the data. The subscribers art? notified by this 
system when the deadline to deliver the data has. passed because of the unavailability of the 
data. The subscribers can be notified according to their preferences .listed in a user 
; personalization profile., More specifically, the user can personalize the way wherein he or she 
. interacts with the system through push technology and pull technology. For example, the user 
.25 : > . can specify what information is to be received, how to get the information (pager, email, 
voice, etc/):; This is illustrated below.. v . t . 

• . :t- Block diagram , , : 1 • . - yi . • ; , . . , - , ; ; , . 

• j , ,Fig. 1 is a block diagram of a system 1 00 according to, the invention. System 
30 1 00 supports automatic notification, and indexing services of patient records and consultation . 
.. notes. In case of an event that needs attention fronj, clinical personnel, system 100 notifies one 
or more specific users through push technology, for example, by means of selective 
transmission of emails that have pointers to relevant pages of medical records accessible on 
the Web. The specific user can then pull the medical records by clicking the pointers. To this 
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end, system 100 comprises client devices, e.g., devices 102 and 1 04, server equipment 106 and 
: databases 108, 110 and 112. Devices 102-104 communicate with databases 108-112 via server 
equipment 106. Server equipment 106 has a Web server (WS) 114 and.an application server 
(AS) 116. Web server 1 14 is a computer running a server program whose sole purpose is to 
5 serve document : data to a client computer^ such as device 102 or 104, in response to receiving a 
1 ; request for that document. Application server 1 16 is a computer that provides access to 

application software.* An action specified at client device 102 or 104 can run an application on 
; ; application server 116. Devices 102-104 comprise Web browsers 118 and 120, respectively, 
each with an appropriate GUI. Devices 102-104 comprise, for example, a desktop PC, a 
10* J palmtop PC, a PDA, a wireless device, a set-top box, or'anyother device with Web browser 
• r capability • a pager, or a telephone answering machine. Database 108 comprises a- 
1 personalization database (P-DB) that contains the user preferences and access privilege 
* information as explained below. Database 110 comprises one or morexlinical databases (C- 
DB) that 1 store patient records and images. Database 1 12 comprises ah indexed mail database 
15 : IM-DB that contains formatted email messages and indices. (pointers, links) to.large, relevant 
patient data and images referred to in the email messages and archived in clinical database 



108-1 12, e.g., update of medical records of specific patient. Server 116 notifies the involved 
20 clinicians with email messages (i.e. through push technology) that comprise embedded links or 
: pointers to large patient data files iiv database 110 (i.e., retrievable through pull technology). 
Besides using emails for notification, 5 application server 116 can also page or make a telephone 
call to the relevant users. The pager numbers and-telephone numbers of the users are stored in 
personalization database 108. A simple memo in the form of an alphanumeric message can be 
' 25 sent to the receiver's pager along with source contact information, such as the phone number 
of pager number of another clinician. For voice messaging; application server 116 synthesizes 
a* voice by translating textual messages into 1 audio signals arid dials the telephone numbers of 
the relevant receivers. Whith way for notification is being used is, in this example, user- 
; dependent and can be specified in ! advance by storing user-preferendes in personalization 
30u: iiataliase 108... v ; ;< ■ : : : L , - • : 1 ' : *, 



110. 



; Application server H 6 automatically keeps track of the events in databases 



f : 
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■ ^' Workflow procedure ; . 

i ■ . - ■ ■ / Operation of system 1 00 is illustrated below with reference to Eig.2, discussing 

: < the procedural steps of electronic communication of personalized medical records for a 
- clinical consultation. < - 

5 . - . . in step 202 an email message is constructed. For example, a patient consults a 

physician and after the patient encounter, the physician sends, one orjnipre emaiLmessages to 
one or more specific clinicians, e.g., a specialist and a nurse. The email relates, to multimedia 
f ." > data, including graphics, audio and video. Such an email message contains a first part and a 
* second part. The first part, has a clinical statement on the patient and contains one or more 
■*—10 links to .be clicked on to retrieve relevant patient data stored in database 110. The second part 
lists action items requested by the referring physician. For example, the clinical statement of 
the email message contains observation data resulting 'from the consult and, in addition, a 
- ■ • -request for an X-ray study on the patient and pointers to previous X-ray reports and images of 
"i - the patient relevant to the case. An 1 action item is for receipt -by a referred radiologistto 
15 perform an X-ray study on the patient and requests to send a diagnosis immediately .back to 
..the referring physician for prognosis. > t 

In step 204 the email message is delivered to the referred clinicians. There are a 
variety <of ways 'to deliver the message, depending on, for example, the urgence of the case, 
i: First, the referring clinician can request system 10.0 to page the receiver once; the message has 
.: 20 been sent. Second, the referring: clinician can specify the time to page the receiver before the 
... -r ' occurrence .of a certain event. For /example, two hours before a scheduled surgery on the 

patient the. radiologist , would like to ensure the surgqon to read the diagnostic interpretation of 
: the latest MRJ study performed on that patipnt. Third, the referring physician simply sends the 

: message -.without any specified period of notification, as : in typical email us^. On the other 
. 25 hand, a clinician can .specify in personalization database 108 how long before a certain event 
he or she would like to be notified. , \ ■ 

In step 206> the email, mes^g? is received ^dTel^vant data is retrieved. The 
referred clinician receives the email message, studies the attached observations and clicks on 
.ii-the relevant links in order to retrieve patient data; of interest for review, e.g., previous 
30 diagnostiareports of the patient's X-ray studies. The referred clinician then responds^ J&e 
request of the referring physician, e.g., by interpreting the results of the latest X-ray study on 
the patient. The formal report can be updated in database 1 10 using existing procedures for 
hospital information systems. However, for fast response and additional comments outside the 
formal reporting structure, the referred clinician can append summaries or comments of the 
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study to the initiator's email and forward them to the initiator and to other relevant parties. 
Email database 112 keeps an audit trail of such messages. 

In step 208, a message : folder : reply (RPL) is created and forwarded. The 
referred clinician composes the reply message with links to new of other relevant patient 
records in system 100 and delivers the message to the referring physician or forwards the 
message to the next care provider for the patient in this particular encounter according to 
procedural step 204. 




BNSDOCID: <WO 9&42933A1 _l_> 



WO 99/42933 



PCT/IB99/00240 



GTJI for Web Browser 

The Table presents a view of a GUI for a Web browser for display on a Web- 
enabled device 1 02, . such as desktop PC, a palmtopPC, e.g., the Velo-1 of Philips Electronics, 
or a digital TV screen. t .. • • .. 



Web Browse* 



Date 


From 


Subject 


Action 


ThuJul31 14:35 97 


Lilly Hoffman 


Need to look at the 
possibility of surgery 


View Modality 


Wed Jul 30 15:15 97 


Bill Smith 


An abnormal turner, 
need pathology exam 


View Modality 


Wed Jul 30 10:5 97 


James Brown 


Please look at this 
case 


View Modality 



Reply 



New 



Delete 



Audio 



Video 



MB 



Dr. Tim Grace, 

A surgery applied to this patient will remove the abnormal tumor. (From Dr. Lilly Hoffman). 
Please schedule the patient to talk to me about the detail. 

■ ORIGINAL MESSAGE 

Dr. Lilly Hoffman, Please look at this case and plan a surgery for this patient. (From Dr. Tim 
Grace) 

— ORIGINAL MESSAGE 



Dr. Bill Smith, please do a pathology exam. (From Dr. Tim Grace) 
ORIGINAL MESSAGE 



There is an abnormal tumor, need pathology exam. (From Dr. James Brown) 
„, ORIGINAL MESSAGE 



Please do X ray examination on this patient to see if there exists any tumor. (Request from 
original physician, Dr. Tim Grace) 
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GUI has fields with labels "Date", "From", "Subject", and "Action", 
respectively. The Date Field indicates the date and time on which a specific email was sent. 
The From-Field indicates the name of the sender of the email. The Subject-Field contains the 
subject of the email. When the user clicks on the underlined subject, GUI shows the email 
5 message in a message box MB .. The Action-Field contains the underlined pointer to pull 

relevant patient records from database 110, including diagnosis reports and images. When the 
user clicks on the pointer, the related reports and images are retrieved from database 110 and 
are presented to the user through a Web browser application or Java-based applets. 

GUI has also buttons, labeled "Reply", "New", "Delete", "Audio" and "Video", 

10 respectively.. When button is clicked, the original message in the image box is attached to a 

reply message that the user can enter and send to other users. When the New-button is clicked, 
the message in the message box is cleared, and the user can enter a new message and specify 
subject and receiver. The link to the current patient case, which the user is looking at, is 
attached as the "Action" message. When the Delete-button is clicked the currently selected 

15 (i.e., viewed) message is deleted and the next message on the list is retrieved and shown in the 
message box. When the user clicks on the Audio-button, a new message will be created by 
.recording thQ dictation from the user, employing a suitable speech-to-text conversion program, 
or the audio message is stored and forwarded as an audio message (i.e., without using speech- 
to-text conversion). When the Video-button is clicked, the user is enabled to record his/her 

20 video and/or audio data to be sent to the receiver. 
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1 M '■"*' 'a method of interacting between multiple users through an electronic records 

database system, wherein: 

- a first user sends to a second user an electronic notification' having a pointer to a record, 

- the notification is being delivered through a push technology; 

5 - the second user uses the pointer to retrieve the record through a pull technology; and 
the notification is being indexed in the database system as related to the record. 

2. The method of claim 1, wherein: 1 . 

- the first user sends an electronic message in response tb the notification; arid 
10 - the message is indexed in the database system as related to the record! 

3. U The method of claim 1, wherein 

- the interacting is personalized according to' a specification by the second user with 
regard to a modality of reception by the second user; and 

15 - the specification has'been stored in the database system. 

4. The method of claim 3, wherein the modality relates to a capability of 
electronic receiving equipment of the second user. 

20 5. The method of claim 3, wherein the modality relates to a temporal relevance of 

the notification. 



6, A method of enabling multiple users to interact through an electronic 

multimedia records database system, the method comprising: 
25 - enabling a first user to send to a second user an electronic notification having a pointer 
to a record, 

- enabling the notification to be delivered through a push technology; 

- enabling the second user to use the pointer for retrieval of the record through a pull 
technology; and 
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enabling the notification to be indexed in the database system as related to the record. 
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